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Keldysh formalism for multiple parallel worlds 


Mohammad Ansari and Yuli V. Nazarov 
Kavli Institute of Nano Science, Delft University of Technology, 
Lorentzweg 1, NL-2628 CJ, Delft, The Netherlands. 

We present here a compact and self-contained review of recently developed Keldysh 
formalism for multiple parallel worlds. The formalism has been applied to consis¬ 
tent quantum evaluation of the flows of informational quantities, in particular, to 
evaluation of Renyi and Shannon entropy flows. We start with the formulation of 
standard and extended Keldysh technique in single world in a form convenient for 
our presentation. We explain the use of Keldysh contours encompassing multiple 
parallel worlds In the end, we shortly summarize the concrete results obtained with 
the method. 


INTRODUCTION 


The seminal work of Leonid Keldysh [l|] has paved the way to modern understanding of 
quantum systems out of equilibrium. One can do much work in the area armed just with 
Fermi Golden Rule and some dehance, yet a consistently scientihc approach will almost 
necessary involve the Keldysh formalism. The formalism has been successfully applied for 
derivations of dynamical equations of complex systems where intuition ceases to work, like 


superconductors 


non-linear sigma-models 


i- 


strongly correlated systems 
For many years the formalism was considered too much complicated for a practical re¬ 
searcher and hardly applied beyond several specihc helds. ’’Keldysh approach” sounded as 
a synonym of unnecessary theorization and an antonym to clear physical reasoning. One of 
us (Y.N) remembers a talk given by a high-class theorist with a taste for abstract models, 
young experimentalists being his primary audience. Somewhere in the middle of the talk he 
said: ’’Now let us move to physical quantities, namely, Keldysh Green functions”. A burst 
of laugh lasted for more than hve minutes. 










2 


The situation begun to change in nineties, and is quite different nowadays. The formalism 
receives much more practical attention, more and more theorists and numerical researchers 


become qualified, nice modern reviews 


, l6| have appeared in addition to the classical ones 


7j. A unique property of Keldysh formalism that distinguishes it from all other diagram¬ 
matic techniques 8| is that the zero-order approximation is generally unstable with respect 
to perturbative corrections. This property is widely appreciated now and makes the tech¬ 
nique an indispensable tool for complex quantum dynamics. 


Recent extensions of Keldysh technique to non-unitary evolution of density matrix 


loj 


allow to access non-trivial problems of quantum statistics and analyze large deviations from 


equilibrium 


ll|. Finite-e’ 


ement approach to Keldysh Green functions for electrons, so-called 


quantum circuit theory 
nanostructures. 


12| proved to be useful to built adequate models of quantum 


6[ providing 


Keldysh technique permits natural formulation in terms of path integrals 
a very instructive picture of ’’doubling” a classical stochastic variable when put on the 
Keldysh contour. This provides a fundamental link between Keldysh and Feymann-Vernon 


formalism. The Keldysh action arising in this context can be evaluated by 


being obtained from a non-unitary evolution 


13|. The Landauer-Buttiker 


dIoc 

;xs. 

14, 

15 


is, each block 
icattering 


approach receives a compact and general formulation in terms of Keldysh action 

All these extensions are still based on time evolution along a single “doubled” Keldysh 
contour. In this paper, we discuss a recent extension in a different direction. Technically, 
the extension involves time evolution along many “doubled” contours. We will refer to these 
pairs of contours as parallel worlds (this terminology has nothing to do with an attempt of 
interpretation of quantum mechanics involving parallel worlds). The closing of the contours 
is typically different for different sub-parts of the quantum system under consideration: for 
some, the contours are closed separately within each world, while for others they can go 
back and forth through all the worlds. 

As we show below, this formalism is natural and indispensable for evaluating the quan- 
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titles that are non-linear in the density matrix. The physical meaning of such quantities 
is not obvious since they do not conform the standard dehnition of a physical observable, 


although they are commonly used in quantum information theory 17j, for instance, for en 


tanglement characterization. Most work and applications have been done for evaluation of 


Renyi entropies 


18l-l20|. We follow these papers in our outlining. 


The paper is organized as follows. In Section [TTl we formulate the standard Keldysh 
formalism in a way convenient for further presentation, putting emphasis on the link between 
Keldysh technique and master or Bloch equations. In Section HTTI we explain the extension of 
the formalism on non-unitary evolution mostly concentrating on the example of full counting 


statistics of energy flows 


2l[ | that is useful in the context of Renyi entropy flows. Then we 


explain the use of parallel worlds concept for evaluation of the conserving quantities related 
to the products of density matrices of sub-parts (Section [IV|) and formulate the diagrammatic 
technique for this situation in Section |Vl The relations between different Keldysh correlators 


for a (sub)system in thermal equilibrium, so-called KMS 


22| relations, are important for 


single-world techniques. We discuss its generalization on multiple worlds in Section IVII 
The rest of the paper is devoted to specihc examples for which the general theory can 
be simplihed and elaborated. We concentrate on second-order diagrams in Section IVIII and 
explain the specihcs of higher-order diagrams in Section rVIIIl We shortly review our recent 
results on quantum heat engines in Section IIXI In Section |X] we discuss a rather general 
correspondence between the statistics of the energy flows and Renyi entropy flows. We 
conclude in Section IXll 


II. STANDARD KELDYSH FORMALISM 

Let us hrst formulate the standard Keldysh formalism in a way that illustrates its po¬ 
tential and at the same time makes direct connections with the problems to be considered 
further in the text. The starting point of the formalism is the formal expression for uni- 
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tary time evolution of the density matrix i? of a quantum system governed by a (generally 
time-dependent) Hamiltonian H(t), 

R{t) = Texp drHir'^ R{t') Texp drHir^ (1) 

Texp(Texp) denote time(anti)ordering in the evolution exponents. 

If we were up to exact quantum evolution of the whole system, we would not need any 
Keldysh technique: a Schr’odinder equation would suffice. At the same time, the resulting 
density matrix would keep the memory of the initial one for infinite time. This is rather 
unphysical. To address physical situations, we need to separate quantum variables onto 
relevant and less relevant ones. Quite generally, it can be achieved by bipartition of the 
Hilbert space: we present it as a direct product A ^ B oi two subparts A and B. The 
Hamiltonian is separated as 

H = Ha+ Hb + Hab, ( 2 ) 

Hab being an operator that involves degrees of freedom in both subspaces, while Ha,b work 
in their respective partitions only. 

This opens up the opportunities to treat a great variety of physical situations. For 
instance, the system A can be a small system with hnite number of states while B can be an 
environment with inhnite number of degrees of freedom. In this case, the density matrix of B 
can be regarded as unchangeable in the course of evolution and will play a role of (thermal) 
reservoir for A: the density matrix Ra will try to adjust to the reservoirs. Alternatively, B 
can be a collection of independent reservoirs kept at different conditions(like temperatures 
and chemical potentials): the system A will try to adjust to these competing reservoirs 
providing the flows of physical quantities, e.g. charge or heat, between the reservoirs. Yet 
another possibility is that A and B are both reservoirs and Hab representing a junction 
between the two. In this case, both Ra and Rb are unchangeable, while the junction 
provides the flows to both reservoirs. 

We will assume that the completely separated systems, whose dynamics are governed 
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FIG. 1: Perturbation theory for a single density matrix on the Keldysh contour. 


by Ha + Hb, form a reasonable zero-order approximation and implement a perturbation 
technique in Hab keeping the calculations as general as possible. We assume “adiabatic 


switching” of the perturbation 


23|: far in the past the coupling is absent, and the density 


matrix is a direct product over subspaces A and B, 


R{—oo) = Ra{—oo) 0 Rb{—oo) 

Ra{—oo) = ''^^Pa\a >< a\; Rb{—oo) = >< «!• 

a a 

Here we label the states in subspaces A (B) with Latin (Greek) indexes. ) The coupling 
slowly grows achieving actual values at time long before t. The time evolution of the density 
matrix is given by 


R{t) = Texp 


dTHABir) R{-oo)fexp ( -i / drHABir) 


(3) 


Hab{t) is taken here in interaction representation. Expanding this in Hab{t) gives pertur¬ 
bation series most conveniently presented as diagrams involving the Keldysh contour (Fig{T]). 
The operators in perturbation series are ordered along the contour. Two parts of the contour 
correspond to time evolution of bra’s and ket’s in the density matrix. The crosses represent 
the (time-dependent) perturbation HAB{t) at a certain time moment. The integration over 
time moments of all perturbations is implied. There is a state index associated with each 
piece of the contour. Since R{—oo) is diagonal, this index does not change when passing 
this element. The index changes if a non-diagonal matrix element of the perturbation is 
involved. Summation over the indices is implied. 

In distinction from most perturbation theories, the zero-order approximation in Keldysh 
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formalism is not stable with respect to small perturbations. For instance, if A is small and 


B is a reservoir, is determined by the reservoir at arbitrary small coupling strength and 
can have nothing to do with the initial Ra{—oo). This implies that we need to re-sum 


the perturbation series. In a single world, there is a simple way to re-sum the perturbation 
series and arrive at a master equation that contains only diagonal elements of density matrix 
(Fig. |2]). For a diagram, we split the time-line by perturbations into the blocks as shown 
in the Figure. The blocks come in two sorts: diagonal ones, that have the same state index 
on both contours, and non-diagonal ones. To compute a diagramm, we need to integrate 
over time duration of each block. For non-diagonal blocks, the integrand is an oscillatory 
function of time and the integral has a chance to converge. For non-diagonal blocks, the 
integrand is a constant, and integration diverges. This indicates that the diagrams need to 
be resumed. If we look at time derivative of the density matrix, it is contributed by the hrst 
non-diagonal block. Summation over the subsequent diagonal blocks replaces R{—oo) with 
the density matrix at time moment right after the hrst non-diagonal block. With this, the 
evolution equation for diagonal matrix elements Paa{t) = Raa,aa can be written as (assuming 
summation over the repeating indices) 



(4) 


^aa,bp{'r) being the sum of the perturbation expansion comprising a non-diagonal block that 


starts from the second order in Hab- If is natural to require that the matrix elements of 
Hab are only non-diagonal, that is, = 0 if either a = b or a = (3. 


If Paa{t) changes slowly in comparison with the typical time-scale of the blocks, one can 
neglect this time-dependence under the integration sign. The integration over time duration 
of the blocks with different indices gives the transition rates Taafi/s = dTWaa,bi 3 i'^)- 
unitarity guarantees that the integration over time duration of the blocks with the same 


indices gives drWaa,aa(T) = —raa,b^ the total transition rate from the state lacc >, that 


is the sum of the partial transition rates, Vaa = Yhbii ^aa,bi 3 - In this way, we come to the 
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FIG. 2: Master equation in Keldysh formalism is obtained from the re-summation of perturbation 
series whereby the time-line is separated into diagonal and non-diagonal (grey-shaded) blocks. The 
state index here encompasses the indices in both subspaces. 

master equation in the traditional form, 


^^Paa ^aaPaa T ^aa,bl3Pbfi- 


(5) 


There are situations when the non-diagonal elements of density matrix are also relevant 
for dynamics. For instance, a relevant subset of quantum states in A can be approximately 
degenerate such that their energy separations are of the order of the rates F or such degen¬ 
eracy is provided by a coherent drive with a frequency that cancels the energy separations. 
A generic example is the quantum heat engine described in Section IIXI Let us treat the 
system 5 as a reservoir for the system A and sum up over its states assuming unchanged 
Rb- Instead of the diagonal blocks, we dehne the blocks where the states at two parts of 
the contour belong to the relevant subset for A and the same state for B. After the re¬ 
summation over these blocks, the evolution of the density matrix in the relevant subset is 
given by 

d 

~ * 

Here is an operator accounting for a weak degeneracy lifting in the relevant set and 
typically includes the coherent drive. Under assumptions of slow change of this matrix, 
Pcdit — r) ~ Pcd(t), one can perform integration over the time duration r of the blocks to 


(KcPct - P^K,) + / W^,rAT)Pci(t - r). 


( 6 ) 













arrive at Bloch equation in its traditional local-in-time form, 


d 


i - pacK,) + r 

ab,cdpcd' 


( 7 ) 


The common feature of the equations dl]) , dS]) , dS]) , O is the existence of the stationary solu¬ 
tion. Mathematically, the linear operator acting on a density matrix in the right hand side 
of the equations has a zero eigenvalue. The existence of the stationary solution is obvious 
from physical reasons and is a consequence of unitary dynamics. The system approaches the 
stationary solution no matter from what initial condition it started its evolution, it forgets 
the initial conditions. As we will see, the extensions of the Keldysh formalism typically do 
not have a stationary solution. 


III. EXTENDED KELDYSH TECHNIQUE 


The extended Keldysh technique is formally dehned through an evolution with the Hamil¬ 
tonians H'^~ that are different at forward and backward part of the Keldysh contour 9, Q. 


R{t) = Texp (i dTH^{T) ) .R(—cxo)Texp i—i drH 


( 8 ) 


While this equation is very similar to Eq. o. the evolution for different Hamiltonians is 
not unitary. Consequently, R{t) is not a density matrix, in particular, its trace is not 1. 
It is natural to call it a pseudo-density matrix. Apparently, it is not physical: what is the 
physical use of it? 

Let us set the Hamiltonians to H^{t) = Hq + x^(r)/, and compute the trace Tr[i?(t)]. 
This depends on the values of x^(t) for all time moments preceding t, Tr[i?(t)] = 
exp(iS{x^(r)}). By expanding Eq. ([8]) in x^(r) one sees that the ‘5 {x^(t)}) is nothing 
but the generating function of all possible Keldysh cumulants of the operator I taken at dif¬ 
ferent moments of time. Therefore, it completely characterizes the time-dependet quantum 
fluctuations. 

The functional ‘5{x^(r)}) is called Keldysh action and is routinely applied in the context 
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of path-integral formulation of the formalism p . In this case, Hq describes a sub-system sub¬ 
ject to a quantum held that typically arises in the course of path-integral representation 
of this variable, and iS{x^(r)})describes the response and back-action of the sub-system on 
this held. It can be used as a block in Feymann-Vernon action that describes the huctuation 


dynamics of the held 


13|- 


Another application of the extended Keldysh formalism is the full counting statistics 


(FCS) 


lOj . Let us set = —x/2, y being a constant in time interval (0,T) and is called 


counting held. The expansion of the Keldysh action in y produces the Keldysh-time-ordered 


cumulants of the quantum variable Q = fg dTl{T). Under certain conditions 


10| , the inverse 


of this generating function gives the probability of a change Q of this variable during the 
time interval, 

P(Q) = [ (9) 


This tec 
voirs. 9 


tinique 
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has been implemented for FCS of the charge transferred between the reser- 


24| 


An accurate dehnition of FCS for conserving quantities implements a gauge transform in 
a bipartition. Let us consider an operator of a conserving quantity O that is separable in 
the bipartition, O = Oa + Ob- Let us dehne a unitary transformation Ua{x) = exp(ixOA) 
and the Hamiltonians on two parts of the contour as 


= Ua(±x/ 2) it V4(=FX'/2). 


( 10 ) 


Since Ha,b commute with O, the coupling Hab is the only part modihed by this transform. 


( 11 ) 


H^ = Ha + Hb + H^b 

The evolution of the pseudo-density matrix is given by an extension of Eq. (|3]), 

R{t) = Texp J drE^^ir'^ .R(—oo)Texp i J drE^^ir'^ . (12) 

Trace of R{t) dehnes a Keldysh action Sx) that gives the statistics of transfers of the quantity 
0 to/from the subsystem A. 
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the latter 

s o 

a 

Ha + Hb 

11, 

21 


This can describe the statistics of conserved quantities such as current and energy flows, 
a special interest for us. In this case, the conserving quantity is the energy 
2l| . The unitary transform is equivalent to time-shift of the operators in the 
interaction representation. The coupling Hab can be quite generally presented as a sum of 
the products of the operators Ai,Bi working in the corresponding subspaces, Hab = AiBi. 
The modified Hab then reads 


^abW = V(* =F x72)A(*)- 


(13) 


The re-summation of the perturbation series made in the previous section is also relevant 
and shall be made for extended Keldysh formalism. The analogue equations can be derived. 
Importantly, since the dynamics is non-unitary, the blocks and rates do not satisfy sum rules 
imposed by unitarity and are generally dependent on counting fields. For instance, in the 
extended master equation (c.f. with Eq. ([5])), 


d 

dt 


Paa ^aaPaa T ^aa,bl3Pb0i 


(14) 


Faa A ^bl3,aa- 

Owing to this, there is no stationary solution to these equations even for stationary 
counting helds. The diagonalization of the linear evolution operator gives a set of the 
solutions of the form 

R{t) (X exp{—Dit) (15) 


, Di being the eigenvalues of the operator. In the long time limit, the general solution will 
be given by the eigenvalue with the smallest real part,T)o- This gives a remarkably simple 
and constructive expression for Keldysh action in the limit of long time intervals T, 


5x) = -TDo. 


(16) 
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IV. WHY MULTIPLE WORLDS? 

Although this fact is rarely discussed, in addition to physical conserving quantities that 
are presented by operators there are conserving quantities that are characteristics of a den¬ 
sity matrix. They are formally unphysical since they are not associated with any physical 
operator observable. An example is provided by the Renyi entropies that are defined as 
traces of integer powers of the density matrix of a closed systemR, 

Sm = Tt[r^} (17) 

Since the quantum evolution of the system is governed by a Hamiltonian H and 

^dR . - 

-,h— = [H,R], 

the density matrices in different momets of time are related by unitary transform and the 
trace of any power of R does not depend on time, dSM/dt = 0. The definition can be 
obviously extended to non-integer M. The more common Shannon entropy is obtained by 
taking the limit 

oc 

S = -TiiRlnR} = - lim ^ = - lim (In ^m/(M - 1)). (18) 

We note that the In Sm is an extensive quantity proportional to the system volume. 

Let us now return to the context of bipartition. For two systems A and B. we can now 
define two sets of Renyi entropies, 

S'-£' = Tr., I(«'''*)“! ; SS? = Tib |(fl™)“| ; (19) 

where the reduced density matrices in two subspaces are defined via the partial traces in 
these subspaces, 

= Trs{R}; = Tr^jR}. (20) 

If the quantum evolutions of the systems are completely independent, 

H = Ha + Hb, 
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Ha,b being operators involving the corresponding subspaces only, the entropies of both sets 
provide the conserved measures, 


d ^(A) _ d (B) _ 

If we take into account the coupling HaB, the Renyi entropies are not conserved anymore. 
Let us assume at the moment the systems A and B are inhtely large and are characterized 
by continuous excitation spectrum while Hab couples a relatively small number of degrees 
of freedom in both systems. This situation is similar to that of two metallic leads kept at 
different chemical potentials and containing practically inhnite number of electrons. If the 
leads are connected by a small junction, hnite electric current flows through the junction, 
while the distribution of electrons in inhnite leads remains unchanged. From this analogy, 
it is natural to conjecture that a hnite Renyi entropy how. Re-how, hows between the 
subsystems A and B. We dehne the hows as time derivatives of extensive quantities. 


UA),iB) _ ^ 1 q{A),{B) ... X 

•'M — 

Owing to conservation of Reneyi entropy in each system, the Re-hows would not depend 
on exact bipartition of the system and are determined by properties of the coupling that 
is in principle described by Hab rather then by the properties of the systems A and B, in 
full analogy with electric current. There is, however, an important diherence. For physical 
quantities the conservation holds in the whole system as well as in each subsystems. For 
instance, elecrtical currents to each lead must satisfy Ia + Ib — 0. As far as Renyi entropies 
are concerned, there is no exact conservation law for a sum hiA^^ -|- InA^f^ at hnite Hab-, 
although these quatities are extensive. There is a conservation law for the total Renyi entropy 
In However, the latter at hnite Hab is the sum In -|- In only approximately, 

up to the terms proportional to the volume of the system. Therefore, in general 


tzA) 

•'M 


+ 


7^0. 


How to compute the hows? The crucial observation is that the standard Keldysh formal¬ 
ism as expressed by Eq. ([3]) can be straightforwardly generalized to any integer number M 
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(A) 

FIG. 3: A diagram of perturbation theory for for M = 3. It involves three parallel worlds. 
Reconnection of Keldysh contours for subspaces A (black) and R (white) accounts for partial trace 
over B and matrix multiplication in A. 

of density matrices. These matrices undergo independent unitary evolution in time interval 
{—oo,t). It is constructive to think of a set of M ’’parallel worlds” and draw the diagrams 
for perturbation series using M parallel bra- and ket-contours. To compute S^A)M(t) with 
this set, we hrst need to ’split’ the contours to account for possibly different ordering of 
operators in subspaces A and B (black and white curves in Fig. [3] that gives the example 
for M = 3). Then we need to reconnect the contours at r = t. All white contours are closed 
within each world, this corresponds to the partial trace over B for each density matrix in¬ 
volved. In contrast to this, the black contours are connected to form a single loop going 
through all the worlds, this corresponds to the matrix multiplication in the dehnition ffTTl) of 
Renyi entropy. This conveniently represents the rules of operator ordering for any diagram 
of particular order in Hab- 

It is interesting to note that the sets of Renyi entropies are not the only conserved 
measures characteristic for a bipartition. Any polynomial in density matrix that is invariant 
with respect to the group Ua®Ub of unitary transforms in two subspaces, would provide 
such a measure. To give a minimal example, let us label the states in A{B) with Latin 
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FIG. 4: Reconnection of Keldysh contours for conserved measure K defined by Eq. (I22p 
(Greek) indices. The quantity 

^ — f^aa,lry^bl3,ca^c'Y,al3 

is a conserved measure that can be reduced neither to the Renyi entropies of the systems nor 
to the Renyi entropy of the whole system. It is interesting to note that the reconnecting the 
contours in a different fashion gives rise to perturbation theory for other conserved measures. 
For instance, for K the contours are reconnected as shown in Fig. IH The characterization 
of all such measures forms an interesting research task beyond the scope of this article. 


V. DIAGRAMMATIC TECHNIQUES FOR MULTIPLE WORLDS 


Let us illustrate diagrammatic techniques arising in this new context. We concentrate on 
evaluation of and skip the index A for brevity. It is natural to require that the matrix 
elements of H^b are only non-diagonal, that is, = 0 if either a = b oi a = (3. In this 

case, the hrst non vanishing diagram giving the correction to Sm will be of the second order 
in Hab- Expressing it in terms of the corrections to Ra, we hnd 


5S^S = M Y. 

0<N<M 


A pd) pN b(l) f)M—N—2 
OJXa ixa it a -tt 


+ MTrA 




(23) 
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Here we use the symmetry of the parallel worlds cyclically permuting Ra and its corrections 
under trace, this gives the factors M in front of the terms. While there is a hrst-order 
correction to it is non-diagonal in B space. Thus 6R^^'^ = 0: we will see that it is not 
the case in the case of quantum heat engine (Section llXj) where the non-diagonal elements 
are important. We only need to deal with SR\ that is concentrated in a single world. 
Expansion in HaB gives four terms that correspond to four ways to place two Hab on two 
parts of the contour in a single world, 

dR^"^ = f dti [ dt2( — HAB{tl)HAB{t2)RARB—RARBHAB{t2)HAB{tl) 

J —oo J—oo ^ 

+ HAB{tl)RARBHAB{t2) + HAB{t2)RARBHABitl)^ (24) 

We need to substitute this to Eq. fl2^ . Let us now assume that Hab = Ai,Bi acting 

on corresponding subspaces. Let us introduce the correlators of these operators. Since the 
contours for the space B are closed within each world, the correlator takes a usual form 


^ 2 ) = Tr^ 


Bi{ti)Bj{t2)RB 


(25) 


A general two-operator correlator in space A is dehned as 


TyN^M _ rp 

K,- =Tr^ 


A,{R)R^^A^{t2)Rf 


M-N 


0-1 


(26) 


indices M, 0 < iV < M corresponding to different arrangements on the contour traversing 
M parallel worlds. We divide by to keep this correlator an extensive quantity. With 
this, 

/ t pti nt poo 

dti / dt2W{ti -12) = / dti / (irW(r) 

-OO J —OO J —oo J 0 

where the block W{tiR 2 ) is expressed as 


+C,,{t2, tl)/^i’'^(tl, t2) + a, (ti, t2)K^-^{h, t2), 


( 27 ) 
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four terms in this equation corresponding to four terms in Eq. (|2^ . So that, the Re-flow is 
expressed in terms of the block W as 

POO 

Tm= / drWir). (28) 

Jo 

More complex diagrams are expressed in terms of those and higher-order correlators that 
have the similar structure. 

Expectedly, the correction to Sm diverges with growing t, so that the Keldysh formalism 
for multiple parallel worlds also requires re-summation. One can introduce one big density 
matrix Raa.hf 3 where the M-dimensional ’’vector” index a comprises the state indices in 
space A for all bra contours, and all other indices are defined similarly. The reduction of 
this density matrix and re-summation of diagonal blocks leads to the analogues of the Eqs. 
dll),©,®,©. For instance, the analogue of Eq. © in parallel worlds reads as follows, 

-^Paa{t) = J drR4a,b/3(r)pb/3(i - r). (29) 

W being the blocks computed similarly to Eq. fl27|) . Similar to that for extended 
Keldysh technique (see Eq. ffTSD l , this equation has a set of non-stationary solutions 
R{t) oc exp(—Dit). The eigenvalues Di and the form of the solution are affected by the 
way the contours are re-connected at t. For the connection way that gives Reneyi entropies, 
the Re-flows are expressed in terms of the eigenvalue with the smallest real part,Do, that 
depends on the number of the worlds involved, 

Dm = Do(M). (30) 


VI. KMS RELATIONS FOR MULTIPLE WORLDS 


The correlators in a general non-equilibrium system are independent. The state of thermal 
equilibrium brings about extra relations between the correlators, that are important since 
they reduce a number of independent parameters in the models of quantum systems. These 
relations are traditionally called Kubo-Martin-Schwinger relations 22|. For instance, the 
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correlators Cij (Eq. (ES])) in frequency representation are expressed in a KMS state at 
temperature T in terms of the real part of dynamical susceptibility Xiji^) 

Cij{uj) = nB{uj)Xij{uj) (31) 

, where nB{uj) = — 1), = h/kBT. 

Let us show that similar relations hold for the multi-world correlators Kij{uj) dehned by 
Eq. (1261) . 

In frequency representation, 

{uj) = j dre'""Tr{ii(0).R^i,(r).R^-'^}/Tr.R^ 

This correlator can be rewritten in the energy basis. 


t^N,M 

= 


/ p-l3NEm p-PEr,{M-N) 

'S^ A- - _ A- _ 


zm 


M 


Z{^M) 


— 2e5 {Em — En -|- u) 


A . A . p I^EnA/I 




(32) 


Z(I3M) 

where Z{I3) is the partition function dehned as Z{[d) = The standard one-world 

correlator reads {u) = f dr exp(iuT)Tr{Ai(0)Aj(T)RA}/TrRA which after simplihca- 
tion becomes equal 2^6 (Em — E^ + u) Ai^nmBj^mn&~^^"/Z{l3). The KMS relation links this 
to dynamical susceptibility: = Xij{^)i^B{i^/T). By substituting this in Eq. (I3^ a 

generalized KMS relation is obtained: 


(w) = IIB (Mu) (w, ft") 


(33) 


While the correlators are for the system at inverse temperature /9, the dynamical suscepti¬ 
bility is taken at different inverse temperature jd* = Mfd. Such temperature rescaling looks 
surprising in the context of KMS relations. However, this is natural in the context of Renyi 
entropies. In the state of thermal equilibrium, the Renyi entropy is expressed in terms of 
free energy at the native and rescaled temperatures. 


lnS„(/}) = M/3(f’(/3-)-A(«). 


( 34 ) 
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VII. EXAMPLE: SIMPLICITY WITH SECOND-ORDER DIAGRAMS 


Let us start with examples of the multi-world Keldysh approach described. In this Sec¬ 
tion, we elaborate on second-order diagrams and obtain a rather general picture of Re-flows 
in this approximation. In a single world, the higher-order diagrams change the values of the 
rates not changing the dynamics qualitatively. As we will see in the next Section, this is not 
the case in multiple worlds: there, the higher-order diagrams do bring a qualitative change. 

We compute the Re-flows in the second order in Hab in a way slightly different from 
that used in the previous Section. It is prohcient to directly compute the time-derivative of 
Sm- For diagrams, this corresponds to placing one of the perturbations at r = f. The only 
way to satisfy the continuity of state index along the white contours is to place the second 
perturbation in the same world. Four contributing diagrams are given in Fig. I VI II We notice 
that the same four diagrams arise in the derivation of Golden Rule transition rate in the 
standard Keldysh formalism. The specihcs of Renyi entropies is reflected in extra factors 
the diagrams acquire in comparison with the case of a single density matrix. We do 
not separate Hab into subspaces and use the correlators but rather express the answer in 
terms of the matrix elements of this operator. 


Wt 


Sm = 


(—M ^ 

I 2-^ \^aa,hl3\ Pa Pc 

\ a,a;6,/3 


+M Y, i//hwiWp„""‘ 

a,a;6,/3 

dt'2Ke 


(36) 


The integral over time t' reduces to 


27r6{Ea + Ea — Eh — E^), 


manifesting energy conservation between the initial state \aa > and hnal state|6/3 >. 


This suggests that we can rewrite the whole expression in terms of Golden Rule rates 
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FIG. 5: Second order diagrams for time derivative of a Renyi entropy. The contributions come 
only from perturbations in the same world, only this world is shown in each diagram. For 

all diagrams, the perturbations are taken at time moments t and t' < t. The letters at the contours 
label the states involved. 

^aa,bi 3 of the transitions between the states \aa > and \b(3 >, 

+ £■„ - Ej - E„). (36) 

With this, the flow reads 

{Sm)J^M = M ^ Taa-,bli{PbPl3-PaPa)Pa~^ ( 37 ) 

a,a;b,p 

We see that the flow vanishes if the systems are in thermodynamic eqnilibrinm at the same 
temperature. Indeed, in this case PbP/s/PaPa = exp((i?6 + Ep — Ea — Eo^lksT) = 1. 

Since the transition rates Taa,bi 3 in Golden rule approximation are symmetric with respect 
to a permutation aa -H- 6/3, we can regroup the terms to arrive at 

(Sm) = m - pf “')■ 

a,b 


( 38 ) 






















































20 


where 


Ta —>-6 aa; bpPa 

a,/3 

gives the total transition rate from the state |a > to the state \h > averaged over all possible 
configurations of system B. Let us use Eq. fl38l) to derive a simplified expression valid in 
zero-temperature limit. In this limit, the system A is initially in the ground state |0 >, so 
that po = I and pa = 0 for a 7 ^ 0, Sm = 1- We obtain 

Bm = —MTq] (39) 

Lq being the total transition rate from the ground state to any other state. Remarkably, 

this involves no assumption concerning the system B: it can be very far from equilibrium. 

Eq. (l38|) is also a convenient starting point to derive the expression for the flow of 

Shannon entropy S. Taking the limit M —)■ 1, we obtain 

oc 

- ^ = X] In (Pb/Pa) ^a^bPa- (40) 

a,b 

Let us assume thermal equilibrium of A. In this case. In (pb/Pa) = {Ea — Eb)/kBT). Summing 
up the energy changes Eb — Ea in the course of individual transitions from a to b, we prove 
that the energy flow to the system A equals 


dE 

dt 


y^^Ta^b{Eb - Ea)Pa 

a, 6 


Comparing this with Eq. fl40p . we recover the text-book relation between the heat and 
entropy flows 


dS 

dt 


1 dE 
ksT dt ’ 


(41) 


that appears to be universally valid within the second-order perturbation theory. Remark¬ 
ably, this involves no assumption about the system B. 


VIII. EXAMPLE: HIGHER-ORDER DIAGRAMS 


Let us analyze the fourth-order diagrams for time derivative of Sm- As above, we assume 
that Hab does not contain diagonal elements. Since white contours are closed within each 
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FIG. 6: A fourth-order ’’quantum” diagram for Rmryi entropy flows. The contributions come 
from perturbations in two different worlds, only these two worlds are shown. The letters on 

the contours label the states involved. 

world, the four perturbations can either all come in the same world or in two pairs in two 
different worlds. If all four come in the same world, they describe a correction to one of the 
Golden Rule transition rates. This correction does not bring anything new and we disregard 
these diagrams in further consideration. 

A diagram involving two different worlds is given in Fig. IVIIIl We see that in general 
the black contour entering a world with perturbations exits it with a different state index. 
For a particular case when these indices are the same, a = b, the diagram diverges upon 
integration over time. This is not surprising since we expand SM(t) oc exp(Jqvf^)- The fourth- 
order expansion thus contains terms oc being the second-order contribution 

to the rate that we have already calculated. Indeed, the diagram with a = 6 is proportional 
to ^^cl therefore does not contribute to fourth-order correction to the flow. We thus 

concentrate on the case a Y b- We call this diagram ’’quantum” since we will see that it 
does not permit an interpretation in terms of ’’classical” transition events. All expressions 
for J^,dS/dt in this Section give fourth-order corrections to these quantities. 

There are 16 diagrams of this sort corresponding to the number of ways the pairs of 
each world can be placed on bra and ket contours. Summing up all of them, we 
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can present the fourth-order correction in the following form: 

J „M-1 _ r,M-l 

dt ^ Pa- Pb 

a,b 

A - uAB) tt(AB) 

-^ab / ^ aa^cjS-^cjS^ba 

c,a,^ 

(tT {{pa + Pb)Pa - 2pcPp) S {Ea + - Ep) - f ^- - 

The structure of the matrix elements in the ’’amplitude” Aab is the same as for an amplitude 
of the transition from the state \aa > to the state \ba >, that is, without the change of 
the state of the subsystem B. Such transition would seem to involve a virtual state \c, (3 >. 
However, the rest of the expression for Aab does not support this interpretation; rather, 
probabilities enter in a form suggesting that the transition takes place between one of the 
states \aa >,\ba > and the state |c/3 >. Therefore, the expression can be associated with 
no ’’classical” transition and corresponds to no actual transition rate. 

Let us assume that the probabilities in the system A depend only on energies of the 
corresponding states. Then it follows from Ea = Eb that pa = Pb- The term in Aab with the 
energy difference in the denominator vanishes and the flow reduces to 

SmEm = {M- l)7rJ2M^iEa - Eb)p^-^; (43) 

a,b 

= 2nJ2 h'AAAI. (p-Po - P-P-s) HE. + E„-E,-Ef). 

We notice that if both systems are in thermal equilibrium, it follows from Ea + E^ = E^A E^ 
that PaPa = PcP^ and the ’’amplitudes” Aab vanish. 

The ’’quantum” contribution derived manifests serious problems with term-by-term per¬ 
turbation theory in the limit of vanishing temperature, indicating non-analytical dependence 
of the flows on coupling strength in the limit of weak couplings and vanishing temperatures. 
The contribution seems to have an evident zero-temperature limit, namely zero, at least 
if the ground state of the system A is not degenerate. Indeed, delta-function in Eq. (142|) 
cannot be satisfied for any state b ^ a. However, analytical continuation to non-integer M 
gives rise to problems. 
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To see this, we can attempt to derive the Shannon entropy flow taking the limit M —)■ 1 
in Eq. (H3l) . We obtain 


dt 


\Aab\^S{Ea - Eb 


a,b 


Pa 


(44) 


that is, the states with lesser probabilities pa contribute most to the entropy flow! Since the 
probabilities of the excited states quickly decrease with decreasing temperature, we expect 
a divergence of the Shannon entropy flow at T —)■ 0 in contrast to vanishing Re-flows. 


In 


18l | , the general expression has been elaborated for a typical quantum transport setup 


where the systems A and B are metallic leads kept at the same temperature but at different 
chemical potentials shifted by eV, and Hab describes electron tunneling between the leads. 
The fourth-order Shannon entropy flow was found to diverge exponentially at T —0. This 
indicates an intriguing non-analyticity of the entropy flows in the coupling strength. 


IX. EXAMPLE: FLOWS IN QUANTUM HEAT ENGINE 

Let us give an example of computation of Re-flows in an interesting system. 

A quantum heat engine (QHE) is a system of several discrete quantum states connected 
to the environments that are kept at different temperature. The motivation for research in 
QHE comes from studying models of photocells and photosynthesis. The thermodynamics of 
QHEs and their fluctuations in the quantum regime is not a continuation of classical results in 
discrete energies, instead features such as quantum coherence that have no classical analogue 


contribute to the heat exchange 


19|. 


We consider a quantum system with discrete states \n) separated into two sets {«}, {d}. 
All states within a set have approximately the same energy Eu{Ed), the splitting e„ within a 
set being much smaller than E^ — Ed > 0. The system is subject to the external held with the 
frequency u ^ Eu — Ed (we set h, ks = I where appropriate) described by the Hamiltonian 
Edr = + and the relevant matrix elements are between the states 

of two sets. To distinguish the sets, let us introduce a matrix Pnm: Vnm = 1 if n G {«} and 
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m G {d}, rjnm = — 1 if rz G {c?} and m G {«}, rjnm = 0 otherwise. 

The quantum system is coupled to a number of environments labeled by a kept at dif¬ 
ferent temperatures Ta. We thus have a multi-partition: the whole space is separated onto 
the space of QHE states and the spaces of the environments. The interaction with an en¬ 
vironment is described by Hint = with Xml being the operators in the 

space of environment a. We assume linear response of each environment on the state of 
quantum system. In this case, each environment is completely characterized by the set of 
frequency-dependent generalized susceptibilities x™i,pq{v) that are related to the correlators 
of X°- dehned as Sml^pq{t) = Tra{Xm„(0)X“q(t)pa}. The fluctuation-dissipation theorem 
yields the relations in frequency domain: Smn,pg{^) = /T)Xmn,pq{^) where Xmn,pqiy) = 
{Xmn,pq{i^) “ Xpq,mn{-^))/i, and the Bose distribution nsii'/T) = l/(exp(/3z/) - 1). 

We concentrate on the Re-flows in one of the environments, which we call a probe en¬ 
vironment. The rates induced by probe environment are assumed to be smaller than all 
other rates. In this case, we can concentrate on the second-order diagrams. We implement 
M-world Keldysh formalism where the contours of QHE and all environments except the 
probe one are closed within each world while the contour of the probe environment traverses 
all the worlds. There are two sorts of the second-order diagrams. The diagrams of the hrst 
sort, that we call incoherent, are within a single world and are similar to those considered in 
Section IVIII The presence of non-diagonal elements of density matrix in QHE gives rise to 
new type of diagrams, that we call coherent one. In this case, two perturbations are located 
in different worlds. 


Collecting all diagrams (see Appendix B in 19|]), we obtain for Xm the following expres 


Sion: 


Xm = 


MnB{Moj/T) 


tibUM — l)uj/T)nB{uj/T)u 


i^Qi Qc 


(46) 


Thus the R-flow is naturally separated onto two parts, which come from incoherent and 
coherent diagrams. The corresponding quantities Qt^c are expressed in terms of the density 
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matrix of the engine p and the dynamical susceptibilities of the probe environment, 

Qi ^ E Pmn\pm^np (cu) (1 + 77.^ (cu/T')) pmnXnp,pm{^}'I^B{^ /T') (46) 

mnp\pnp=l 

Qc ^ E PnmPqp"X.mn^pq {u) (47) 

mnpq-,ripq=l 

The same-world diagrams contribute to the incoherent part that is proportional to Qi. Qi 
is linear in p so that is an observable. The different-world diagrams form the coherent part 
oc Qc that is quadratic in p and in principle would not be observable. The M dependence is 
identical for both parts. 

Let us interpret the parts and the quantities Qi^c- Qi is an observable: the total energy 
flow to the probe environment. The terms oc 1 -|- describe absorption of energy quanta 
hw by the environment, while those oc ns correspond to the emission to the system. Upon 
taking limit M —)■ 1, the incoherent part reproduces the textbook equation for the entropy 
flow, J^s = Qi/Tb- 

The interpretation of the coherent part is more involved and interesting. Let us replace 
|m)(n| in Hint the operators with classical external forces fmn with time-dependence fmn oc 
exp{—iu)rimn)■ These classical forces would cause energy dissipation to the probe environment 
that is determined from the forces and the dissipative part of susceptibility y. This energy 
dissipation is Qc- 

Both parts of R-flows can be extracted from the measurement results, although in a 
different way. The entropy flow is not directly related to energy flow. Rather, 

J^S = {Q^ - Qc)/Tb (48) 

the difference is due to quantum coherent effects in our heat engine. Similar relation holds 
for the Renyi entropy flow in the low-temperature limit 

Hm = M{Q, - Qc)/u (49) 

(this limit does not commute with M —)■ 1 since Hs diverges at low temperatures). In the 
absence of coherent effects, low-temperature R-flow is readily interpreted semiclassically 


i8i 
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as number of events (in our case, hw quantum absorptions) per second in M parallel worlds. 
With coherencies, such simple interpretation does not work since J^m can be negative Q. 


X. EXAMPLE: EXACT CORRESPONDENCE 


Another example of the Keldysh multi-world formalism is a relation which we derive for 
coherent and incoherent second-order diagrams in general time-dependent situation. This 
relation gives an exact correspondence between formally unphysical Re-flows and physical 
observables, namely, the full counting statistics of energy transfers considered in Section IIIII 
As discussed in section IIVI the Renyi entropies in quantum physics are considered un¬ 
physical, or non-observable, due to their nonlinear dependence on density matrix. Such 
quantities cannot be determined from immediate measurements; instead their quantihca- 
tion seems to be equivalent to determining the density matrix. This requires reinitialization 
of the density matrix between many successive measurements. Therefore the flows of Renyi 
entropy between systems are the conserved measures of non-physical quantities. 

An interesting and non-trivial question is: Is there any relation between the flows of Renyi 
entropy and the physical flows? An idea of such relation was hrst put forward by Levitov 


and Klich in 25|, where they proposed that the Shannon entropy flow can be quantihed 


from the measurement of full counting statistics (FCS) of charge transfers. The validity 
of this relation is restricted to vanishing temperature and obviously to the systems where 
interaction occurs by means of charge transfer. In this section we present a relation which 


is similar in spirit, for details see 


20 |. 


Let us consider two quantum systems A and B. We assume that the system A is inhnitely 
large and is kept in thermal equilibrium at temperature T. The system B is arbitrary: it 
can encompass several degrees of freedom as well as inhnitely many of those. It does not 
have to be in thermal equilibrium and in general is subject to time-dependent forces. It is 
convenient to assume that these forces are periodic with period r. However this period does 
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not enter explicitly in formulation of our result, which is also valid for aperiodic forces. The 
only requirement is that there is a stationary limit of the flows of physical quantities to the 
system A. The stationary limit is dehned by averaging the instant flow over the period r. 
For aperiodic forces it is determined by averaging over sufficiently long time interval. 

The energy transfer is statistical. In section IIIII we discussed the full counting statistics 
of energy transfers. The FCS of energy transfer in system A during the time interval [0, 7~] 
can be determined from Eq. fll2p . For quantihcation of the Renyi entropy flow we need to 
dehne an auxiliary FCS of energy transfer. The most general interaction Hamiltonian is 
Hab = Yhn ^nBn with An being operators in the space of the system in thermal equilibrium, 
and Bn being those in the space of the arbitrary system. Let us replace Bn with their 
average values Bn —)■ {Bn). The resulting Hamiltonian is that of the equilibrium system 
subject to time dependent external forces. Those induce energy transfers to the system to be 
characterized by a FCS. We discuss below possible physical realization of the scheme. So we 
have two FCSs. In the limit of long T, their cumulant-generating functions(Keldysh actions) 
are proportional to the time interval, Si{^) = —/j(0 (incoherent) and Sc{^) = —fdO 
(coherent), ^ being the counting held of energy transfer to/from the system A. 

Our main result is the following exact correspondence: 

= r = </3(M-i) (so) 

which indicates that the Renyi entropy how of the order M to the system kept at temperature 
T = is exactly equal to the diherence of the FCS of incoherent and coherent energy 

transfers to the system kept at temperature T/M at the hxed characteristic parameter 
This relation is valid in the limit of weak coupling, where the interaction between the systems 
can be treated perturbatively. 

There is an obvious classical limit for the case where the quantum system B is considered 
to be classical. All operators Bn are numbers corresponding to classical forces acting on the 
system in thermal equilibrium. In this case the dynamics of the system is governed by the 


Hamiltonian in degrees of freedom of the system and therefore will be unitary. In this case 
there will be no entropy flow. This can be separately understood only from looking into the 
FCS in the the correspondence (l50j) : in this case fi = fc- 

The entropy/FCS correspondence (l50l) allows us to quantify the time flow of Renyi as 
well as Shannon entropy. These quantities are not accessible in direct measurement as they 
are non-linear functions of density matrix. Direct measurements of density matrix for a 
probe environment requires characterization of reduced density matrix of an inhnite system, 
which is a rather non-trivial procedure and needs the complete and precise reinitialization 
of the initial density matrix. However, measuring the entropy flow from the correspondence 
requires that some generating functions are extracted from determining statistical cumulants 
of transferred energy in experimental data. This can be done equally well for imaginary and 
real values of the characteristic parameter. The measurement procedures may be complex, 
yet doable and physical. 

The correspondence can have many other advantages; for instance: a complete under¬ 
standing of entropy flows may help to identify the sources of fidelity loss in quantum com¬ 
munications and methods to prevent or control them. 

XI. CONCLUSIONS 

We have formulated and illustrated here a fascinating extension of Keldysh formalism 
on multiple parallel worlds. Keldysh contours in this scheme are different for different sub¬ 
parts of a quantum system, this provides dependencies between the worlds. We explain that 
the formalism naturally arises in the context of characterization of the flows of conserved 
measures: Renyi entropies, and illustrate its similarities with single-world extensions of 
Keldysh formalism. 

It is a big honour for us to present these results in a special issue celebrating numerous 
scientific merits of Leonid Veniaminovich Keldysh. We gladly appreciate his pioneering 
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research that provided a powerful and indispensable tool for many generations of quantum 
physicists, us including, and wish him many happy returns of the day. 

Acknowledgments 

The research leading to these results has received funding from the European Union 
Seventh Framework Programme (FP7/2007-2013) under grant agreement n 308850 (IN¬ 
FERNOS). 


[1] L. V. Keldysh, Zh. Eksp. Teor. Fiz., 47, 1515 (1964) [Sov. Phys. JETP, 20, 1018 (1965)]. 

[2] A.I. Larkin and Yu.N. Ovchinnikov, ZhETF, 68 , 1915 (1975) [ Sov. Phys. JETP 41(5), 960 
(1975)]. 

[3] G. D. Mahan, Manyparticle physics, Plenum Press, NY, (1990). 

[4] A. Kamenev, A. Levchenko, Advances in Physics 58, 197 (2009). 

[5] A.P. Jauho, arXiv:cond-mat/0208577. 

[6] A. Kamenev, Field Theory of Non-Equilibrium Systems, Cambridge University Press, Cam¬ 
bridge, (2011). 

[7] J. Rammer and H. Smith, Rev. Mod. Phys. 58, 323 (1986). 

[8] A. A. Abrikosov, L. P. Gorkov, and 1. E. Dzyaloshinski, Methods of Quantum Field Theory in 
Statistical Physics, Courier Corporation, 1975. 

[9] Yuli V. Nazarov, Y.M. Blanter, Quantum Transport. Introduction to Nanoscience, Cambridge, 
Cambridge University Press, (2009). 

[10] Yu. V. Nazarov, M. Kindermann Eur. Phys. J. B 35, 413 (2003). 

[11] T. T. Heikkil’a and Yuli V. Nazarov, Phys. Rev. Lett. 102, 130605 (2009). 

[12] Yu.V. Nazarov, Superlattices and Microstructures 25, 1221 (1999) 

[13] 1. Snyman, Yu. V. Nazarov Phys. Rev. B 77, 165118 (2008). 

[14] M. Buttiker, Y. Imry, R. Landauer, and S. Pinhas, Phys. Rev. B 31, 6207 (1985). 

[15] M Buttiker, Phys. Rev. Lett. 57, 1761 (1986). 

[16] Yuli V. Nazarov, arXiv:1507.03039, Physica E, to be published. 




30 


[17] G. Jaeger, Quantum Information, Springer, Berlin (2007). 

[18] Yuli V. Nazarov, Phys. Rev. B 84, 205437 (2011) 

[19] M. H. Ansari, Yu. V. Nazarov, Phys. Rev. B 91, 104303 (2015). 

[20] M. H. Ansari, Yu. V. Nazarov, Phys. Rev. B 91, 174307 (2015). 

[21] M. Kindermann and S. Pilgram, Physical Review B 69, 155334 (2004). 

[22] R. Kubo, J. Phys. Soc. Japan 12, 570 (1957), P. Martin and J. Schwinger, Phys. Rev. 115, 
1342 (1959). 

[23] L. P. Pitaevskii and E.M. Lifshitz, Physical Kinetics, Butterworth-Heinemann, 2012. 

[24] L. S. Levitov, H. W. Lee, and G. B. Lesovik, J. Math. Phys. 37, 4845 (1996). 

[25] 1. Klich and L. S. Levitov. Phys. Rev. Lett. 102, 100502 (2009). 


